Sebastian Stan was concerned about Tom Hiddleston during Taylor Swift romance

"I don't know, I was really worried, mainly for him," Stan said on Thursday's episode of "Watch What Happens Live."